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1 Introduction 

Sentiment analysis is an application of natural lan¬ 
guage processing that focuses on identifying ex¬ 
pressions that reflect authors’ opinion-based atti¬ 
tude (i.e., good or bad, like or dislike) toward en¬ 
tities (e.g., products, topics, issues) or facets of 
them (e.g., price, quality). 

Since the early 2000s, a large number of mod¬ 
els and frameworks have been introduced to ad¬ 
dress this application, with emphasis on various 
aspects like opinion related entity exaction, review 
mining, topic mining, sentiment summarization, 
recommendation, and these extracted from signif¬ 
icantly diverse text sources including product re¬ 
views, news articles, social media (blogs, Twitter, 
forum discussions), and so on. 

However, despite this activity, disappointingly 
little has been published about what exactly a sen¬ 
timent or opinion actually is. It is generally simply 
assumed that two (or perhaps three) polar values 
positive, negative, neutral) are enough, and that 
they are clear, and that anyone would agree on how 
to assign such labels to arbitrary texts. Further, 
existing methods, despite employing increasingly 
sophisticated (and of course more powerful) mod¬ 
els (e.g., neural nets), still essentially boil down 
to considering individual or local combinations of 
words and matching them against predefined lists 
of words with fixed sentiment values, and thus 
hardly transcend what was described in the early 
work by Pang et al. (2002). 

There is nothing against simple methods when 
they work, but they do not always work. The goal 
of this paper is to identify why sometimes they do 
not work, and where to go next. We try to iden¬ 
tify gaps in the current sentiment analysis litera¬ 
ture and to outline practical computational ways 
to address these issues. 

Goals, Expectations and Sentiments. We be¬ 
gin with the fundamental question “What make 


people hold positive attitudes towards some enti¬ 
ties and negative attitudes toward others?”. The 
answer to this question is a psychological state 
that relates to the opinion holder’s satisfaction 
and dissatisfaction with some aspect of the topic 
in question. One of only two principal factors 
determines the answer: either (1) the holder’s 
deep emotionally-driven, non-logical native pref¬ 
erences, or (2) whether (and how well) one of the 
holder’s goals is fulfilled, and how (in what ways) 
the goal is fulfilled. 

Examples of the former are reflected in sen¬ 
tences like “I just like red” or “seeing that makes 
me happy”. They are typified by adverbs like 
“just” and “simply” that suggest that no further 
conscious psychological reflection or motivation 
obtains. Of this class of factor we can say noth¬ 
ing computationally, and do not address it in the 
rest of this chapter. 

Fortunately, a large proportion of the attitudes 
people write about reflect the other factor, which 
one can summarize as goal-driven utility. This re¬ 
lates primarily to Consequentialism: both to Utili¬ 
tarianism, in which pleasure, economic well-being 
and the lack of suffering are considered desirable, 
but also to the general case that morally justifiable 
actions (and the objects that enable them) are de¬ 
sirable. That is, the ultimate basis for any judg¬ 
ment about the rightness or wrongness of one’s ac¬ 
tions, and hence of the objects that support/enable 
them, is a consideration of their outcome, or con¬ 
sequence. 

In everyday life, people establish and maintain 
goals or expectations, both long-term or short¬ 
term, urgent or not-urgent, ones. Achieving these 
goals would fill one with satisfaction, otherwise 
dissatisfaction: a man walks into a restaurant to 
achieve the goal of getting full, he cannot be sat¬ 
isfied if all food was sold out (the main goal not 
being achieved). A voter would not be satisfied 
if his candidate or party fails to win an election. 



since the longer-term consequences would gener¬ 
ally work against his own preferences. The gener¬ 
ation of sentiment-related texts is guided by such 
sorts of mental satisfaction and dissatisfaction in¬ 
duced by goals being achieved or needs being ful¬ 
filled. 

We next provide some examples to illustrate 
why identifying these aspects is essential and fun¬ 
damental for adequate sentiment/opinion analysis. 
Following the most popular motivation for com¬ 
putational sentiment analysis, suppose we wish to 
analyze customers’ opinions towards a product or 
an offering. It is not sufficient to simply deter¬ 
mine that someone likes or dislikes something; to 
make that knowledge useful and actionable, one 
also wants to know why that is the case. Espe¬ 
cially when one would like to change the opinion, 
it is important to determine what it is about the 
topic that needs to be changed. 

Case (1) 

• Question: Why did the customer like deter¬ 
gent X? 

• Customer’s review: The detergent removes 
stubborn stains. 

No general sentiment indicator is found in the 
above review. But the review directly provides the 
reason, and assuming his/her goal of clean cloth¬ 
ing is achieved, it is evident that the opinion holder 
holds a positive opinion towards the detergent. 

Case (2) 

• Question: Why did the traveller dislike flight 
Y? 

• Customer’s review: The food was good. The 
crew was helpful and took care of everything. 
The service was efficient. However the flight 
was supposed to to take 1.5 hours but was 3 
hours late, and I missed my next connecting 
flight. 

The major goal of taking a flight is to get to your 
destination, which is more important than goals 
like enjoying one’s food and receiving pampering 
service. While multiple simultaneous goals induce 
competing opinion decisions, the presence of an 
importance ranking among them determines the 
overall sentiment. 


Case (3) 

• Question: Why did the customer visit restau¬ 
rant Z? 

• Reviewl.- The food is bad. 

• Review!.' The waiter was kind but the food 
was bad. 

• Review3.' The food was good but the waiter 
was rude. 

Although the primary goal of being sated may be 
achieved, secondary goals such as enjoying the 
food and receiving respectful service can be vio¬ 
lated in various combinations. Often, these goals 
pertain to the method by which the primary goal 
was achieved; in other words, to the question 
“how?” rather than “why?”. 

A sentiment determination algorithm that can 
provide more than just a simple opinion label 
thus has to pay attention both to the primary 
reason behind the holder’s involvement with the 
topic (“why?”) and to the secondary reasons (both 
“why?” and “how?”), and has to be able to deter¬ 
mine their relative importance and relationship to 
the primary goal. 

Goals and Expectations are Personal. As dif¬ 
ferent people (opinion holders) are from different 
backgrounds, have different personalities, and are 
in different situations, they have different goals, 
needs, and the expectations of life. This diversity 
generally leads to completely diverse opinions to¬ 
wards the same entity, the same action, and the 
same situation: a billionaire wouldn’t be the least 
bit concerned with the price in a bread shop but 
would consider the quality, while a beggar might 
care only about the price. This rather banal obser¬ 
vation is explained best by Maslow’s famous hier¬ 
archy of needs (Maslow, 1943), in which the beg¬ 
gar’s attention focuses on Maslow’s Physiologi¬ 
cal needs while the billionaire’s focuses on Self- 
Actualization; more on this in Section 3.1. 

Life Requires Trade-offs. Most situations in 
real life address many personal needs simultane¬ 
ously. People thus face trade-offs between their 
goals, which entails sacrificing the achievement of 
one goal for the satisfaction of another. Given the 
variability among people, the rankings and deci¬ 
sion procedures will also from individual to in¬ 
dividual. However, Maslow’s hierarchy describes 



the general behavioral trends of people in most so¬ 
cieties and situations. 

Complex Sentiment Expressions. As far as we 

see, current opinion analysis frameworks mostly 
fail to address the kinds of issues mentioned 
above, and thereby impair a deeper understand¬ 
ing about opinion or sentiment. As a result, they 
find it impossible to provide even rudimentary 
approaches to cases such as the following (from 
(Hovy, 2015)): 

1. Peter thinks the pants are great and I cannot 
agree more. 

2. Peter thinks the pants are great but I don’t 
agree. 

3. Sometime I like it but sometimes I hate it. 

4. Pie was half excited, half terrified. 

5. The movie is indeed wonderful, but for some 
reason, I just don’t like it. 

6. Why I won’t buy this game even though I like 
it. 

In this paper, we explore the feasibility of address¬ 
ing these issues in a practical way using machine 
learning techniques currently available. 

2 A Review of Current Sentiment 
Analysis 

Here we give a brief overview of tasks in current 
sentiment analysis literature. More details can be 
found in (Liu, 2010; Liu, 2012). 

The key points involved at the algorithm level 
in the sentiment analysis literature follow the ba¬ 
sic approaches of statistical machine learning, in 
which a gold-standard labeling of training data is 
obtained through manual annotation or other data 
harvesting approaches (e.g., semi-supervised or 
weakly supervised), and this is then used to train a 
variety of association-learning techniques who are 
then tested on new material. Usually, some text 
unit has to be identified and fhen associafed wifh a 
senfimenf label (e.g., positive, neufral, negafive). 
Based on fhe annofafed dafasef, fhe techniques 
learn fhaf vocabulary items like “bad”, “awful”, 
and “disgusfing” are negafive senfimenf indicators 
while “good”, “fanlaslic” and “awesome” are pos- 
ifive ones. The main complexify lies in learning 
which words carry some opinion and, especially. 


whaf fo decide in cases where differenl words wifh 
opposife labels appear in fhe same clause. 

Basic senfimenf analysis identifies fhe simple 
polarity of a fexf unif (e.g., a foken, a phrase, a 
senfence, or a documenf) and is framed as a bi¬ 
nary or mulfi-class classification fask; see for ex¬ 
ample Pang ef al’s work (2002) fhaf uses a uni¬ 
gram/bigram fealure-based SVM classifier. Over 
fhe pasf 15 years, fechniques have evolved from 
simple rule-based word mafching to more sophis- 
ficafed fealure and signal (e.g., local word com¬ 
position, facels of topics, opinion holder) idenfi- 
ficafion and combinafion, from fhe level of single 
tokens fo enfire documenfs, and from ‘llal’ word 
sfrings wifhouf any synfacfic sfrucfure al all fo in¬ 
corporation of complex linguistic sfrucfures (e.g., 
discourse or mixed-affecl senfences); see (Pang 
and Lee, 2004; Hu and Liu, 2004; Wiebe el ah, 
2005; Nakagawa el ah, 2010; Maas el ah, 2011; 
Tang el ah, b; Qiu el ah, 2011; Wang and Manning, 
2012; Tang el ah, a; Yang and Cardie, 2014a; Sny¬ 
der and Barzilay, 2007). Recenl progress in neural 
models provides new fechniques for local compo¬ 
sition of bolh opinion and sfrucfure (e.g., subordi¬ 
nation, conjunction) using dislribuled represenfa- 
fions of fexf unite (e.g., (Socher el ah, 2013; Irsoy 
and Cardie, 2014a; Irsoy and Cardie, 2014b; Tang, 
2015; Tang el al, 2014)). 

A supporling line of research exlends fhe ba¬ 
sic senfimenf classification fo include relaled as- 
pecls and facels, such as idenlifying opinion hold¬ 
ers, fhe topics of opinions, lopics nol explicifly 
mentioned in fhe fexf, elc.; see (Choi ef ah, 2006; 
Kim and Hovy, 2006; Kim and Hovy, 2004; Li 
and Hovy, 2014; Jin el ah, 2009; Breck el ah, 
2007; Johansson and Moschilli, 2010; Yang and 
Cardie, 2012; Yang and Cardie, 2013; Yang and 
Cardie, 2014b). These approaches usually employ 
sequence labeling models (e.g., CRF (Lafferly el 
al, 2001), HMM (LIU el al, 2004)) to identify 
whelher fhe currenl foken corresponds fo a specific 
senlimenl-relaled aspecl or facel. 

An imporlanf pari of such supporlive work is fhe 
idenlificalion of fhe relevanl aspecls or facels of 
fhe topic (e.g., fhe ambience of a reslauranl vs. ifs 
food or slaff or cleanliness) and fhe correspondenf 
senfimenf; see (Brody and Elhadad, 2010; Lu el 
ah, 2011; Titov and McDonald, 2008; Jo and Oh, 
2011; Xueke el ah, 2013; Kim el ah, 2013; Garcfa- 
Moya el ah, 2013; Wang el ah, 2011; Moghaddam 
and Esler, 2012). Online reviews (aboul producls 



or offerings) in crowdsourcing and traditional sites 
(e.g., yelp, Amazon, Consumer Reports) include 
some sort of aspect-oriented star rating systems 
where more stars indicate higher level of satisfac¬ 
tion. Consumers rely on these user-generated on¬ 
line reviews when making purchase decisions. To 
tackle this issue, researchers invent aspect identifi¬ 
cation or target extraction approaches as one sub- 
field of senfimenf analysis. These approaches firsf 
identify ’aspecfs/facefs of fhe principal Topic and 
fhen discover aufhors’ corresponding opinions for 
each one; e.g., (Brody and Elhadad, 2010; Tifov 
and McDonald, 2008). Aspecfs are usually iden¬ 
tified eifher manually or automatically using word 
clusfering models (e.g., LDA (Blei el ah, 2003) 
or pLSA). However, real life is usually a lof more 
complex and much harder to break info a series of 
facels (e.g., qualify of living, marriage, career). 

Other related work includes opinion summa¬ 
rization, aiming to summary sentiment key points 
given long texts (e.g., (Hu and Liu, 2004; Liu et 
ah, 2005; Zhuang et ah, 2006; Ku et ah, 2006)), 
opinion spam detection aiming at identifying fic¬ 
titious reviews generated to deceive readers (e.g., 
(Ott et ah, 2011; Li et ah, ; Li et ah, 2013; Jin- 
dal and Liu, 2008; Lim et ah, 2010)), sentiment 
text generation (e.g., (Mohammad, 2011; Blair- 
Goldensohn et ah, 2008)), and large-scale sen¬ 
timent/mood analysis on social media for trend 
detecion (e.g., (O’Connor et ah, 2010; Bollen et 
ah, 2011; Conover et ah, 2011; Paul and Dredze, 
2011 )). 

3 The Needs and Goals behind 
Sentiments 

As outlined in Section 1, this chapter argues that 
an adequate and complete account of utilitarian- 
based sentiment is possible only with reference to 
the goals of the opinion holder. In this section we 
discuss a classic model of human needs and asso¬ 
ciated goals and then outline a method for deter¬ 
mining such goals from text. 

3.1 Maslow’s Hierarchy of Needs 

Abraham Maslow (Maslow, 1943; Maslow, 1967; 
Maslow et ah, 1970; Maslow, 1972) developed a 
theory of the basic human needs as being orga¬ 
nized in a hierarchy of importance, visualized us¬ 
ing a pyramid (shown in Ligure 1), where needs at 
the bottom are the most pressing, basic, and funda¬ 
mental to human life (that is, the human will tend 



Ligure 1: Maslow’s Hierarchy of Needs. Lig¬ 
ure borrowed from Wikipedia https ://en. 
Wikipedia.org/wiki/Abraham_Maslow 

to choose to satisfy them first before progressing 
to needs higher up). 

According to Maslow’s theory, the most basic 
two levels of human needs are^: 

• Physiological needs: breathing, food, water, 
sleep, sex, excretion, etc. 

• Safety Needs: security of body, employment, 
property, heath, etc. 

which are essential for the physical survival of a 
person. Once these needs are satisfied, people fend 
to accomplish more and move to higher levels: 

• Love and Belonging: psychological needs 
like friendship, family, sexual infimacy. 

• Lsfeem: fhe need to be compefenf and rec¬ 
ognized such as fhrough sfafus and level of 
success like achievemenf, respecf by ofhers, 
efc. 

These four fypes of needs are also referred fo as 
DEFICIT NEEDS (or D-NEEDS), meaning fhaf for 
any human, if he or she doesn’f have enough of 
any of fhem, he or she will experience fhe de¬ 
sire fo obfain fhem. Less pressing fhan fhe D- 
needs are fhe so-called GROWTH needs, includ¬ 
ing Cognitive, Aesfhefic (need for harmony, or¬ 
der and beaufy), and Self-aclualizafion (described 

'References from 

https://en.wikipedia.org/wiki/Abrahara_ 
Maslow; 

https://en.wikipedia.org/wiki/Maslow' s_ 
hierarchy_of_needs; 

http://WWW.edpsycinteractive.org/topics/ 
conation/maslow.html 












by Maslow as “the desire to aeeomplish every¬ 
thing that one ean, to beeome the most that one 
ean be”). Growth needs are more generalized, ob- 
seure, and eomputationally ehallenging. We fo- 
eus in this ehapter on defieit needs. For further 
reading, refer to Maslow’s original papers (1943; 
1967) or relevant Wikipedia pages. 

We note that real life offers many situations in 
whieh an aetion does not easily align with a need 
listed in the hierarehy (for example, the goal of 
British troops to arrest an Irish Republiean Army 
leader or of US troops to attaek Iraq). Addition¬ 
ally, a single aetion (e.g., going to eollege, look¬ 
ing for a job) ean simultaneously address multiple 
needs. Putting aside sueh eomplex situations in 
this ehapter, we foeus on more traetable situations 
to illustrate the key points^. 

3.2 Finding Appropriate Goals for Actions 
and Entities 

Typically, eaeh defieit need gives rise to one 
or more goals that impel the agent (the opinion 
holder) to appropriate aetion. Following standard 
AI and Cognitive Seienee practice, we assume that 
the agent instantiates one or more plans to achieve 
his or her goals, where a plan is a sequence of 
actions intended to alter the state of the world 
from some situation (typically, the agent’s initial 
state) to a situation in which the goal has been 
achieved and the need satisfied. In each plan, ifs 
acfions, fheir preconditions, and fhe enfifies used 
in performing fhem (fhe plan’s so-called props) 
consfilule fhe maferial upon which senfimenf anal¬ 
ysis operafes. For example, fhe goal fo sate 
one’s hunger may be achieved by plans such as 
visit-restaurant, cook-and-eat-meal-at-home, buy- 
or-steal-ready-made-food, cadge-meal-invitation, 
efc. In all fhese plans, food is one of fhe props. 
For fhe resfauranf and buying-food plans, an af¬ 
fordable price is an imporfanf precondifion. 

A senfimenf defection sysfem fhaf seeks fo un- 
dersfand why fhe holder holds a specific opin¬ 
ion valence has fo defermine fhe specific acfions, 
preconditions, and props fhaf are relevanf fo fhe 
holder’s goal, and fo whaf degree fhey suffice. In 
principle, a complefe accounf requires fhe system 
fo infer from fhe given fexf: 

^However, putting them aside them doesn’t mean that we 
don’t need to explore and explain these complex situations. 
On the contrary, these situations are essential and fundamen¬ 
tal to the understanding of opinion and sentiment, but requires 
deeper and more systematic exploration in psychology, cog¬ 
nitive science, and AI. 


1. whaf need is active, 

2. which goal(s) have been acfivafed fo address 
fhe need, 

3. which plan(s) is/are being followed fo 
achieve fhe goal(s), 

4. which acfions, preconditions, and props ap¬ 
pear in fhese plan(s), 

5. which of fhese is/are being falked abouf in fhe 
fexf, 

6. how well if/fhey acfually have furlhered fhe 
agenf’s plan(s), 

from which fhe senfimenf valence can be aufomaf- 
ically deduced. When fhe valence is given in fhe 
fexf, one can work ‘backwards’ fo infer step 6, and 
possibly even earlier sfeps. 

Defermining all fhis is a fall order for compu- 
fafional sysfems. Forfunafely, if is possible fo cir- 
cumvenf much of fhis reasoning in pracfice. For 
mosf common sifuafions, a relafively small sef of 
goals and plans obfains, and fhe relevanf acfions, 
preconditions, and props are usually quite sfan- 
dard. (In facl, fhey are precisely whaf is fypi- 
cally called ‘facels’ in fhe senfimenf analysis lifer- 
afure, for which, as described in Secfion 2, various 
techniques have been investigated, albeif wifhouf a 
clear undersfanding of fhe reason fhese facefs are 
imporfanf.) 

Given fhis, fhe principal unaddressed compu- 
fafional problem foday is fhe determination from 
fhe fexf of fhe original need or goal being expe¬ 
rienced by fhe holder, since fhaf is whaf ties fo- 
gefher all fhe ofher (and currenfly invesfigafed) as- 
pecfs. How can one, for a given topic, defermine 
fhe goals an agenf would fypically have for if, sug- 
gesf likely plans, and pofenfially pinpoinf specific 
acfions, precondifions, and props? 

One approach is fo perform automated goal 
and plan harvesting, using fypical fexf mining 
/ paflern-mafching approaches from Information 
Exfracfion. This is a relafively mafure applica¬ 
tion of NLP (Hears!, 1992; Riloff, 1997; Riloff, 
1999; Snow, 2005; Davidov, 2006; Efzioni, 2005; 
4; Mifchell, 2009; Riffer, 2009 fifleWhaf is fhis 
anyway Aufomafic hypernym discovery bookfi- 
fleProceedings of fhe AAAI spring symposium on 
learning by reading and learning fo read; Kozareva 
and Hovy, 2013), and fhe harvesfing power and 
behavior of various sfyles of pafferns has been 



investigated for over two deeades. (In prae- 
tiee, the Double-Anehored Pattern (DAP) method 
(Kozareva and Hovy, 2013) works better than most 
others.) Stated simply, one creates or automati¬ 
cally induces text patterns anchored on the topic 
(e.g., a camera) such as 

“I want a camera because * ” 

“If I had a camera I could * ” 

“the main reason to get a camera is * ” 
“wanted to *, so he bought a camera” 
etc. 

and then extracts from large amounts of text the 
matched VPs and NPs as being relevant to the 
topic. Appropriately rephrased and categorized, 
one obtains the information harvested by these 
patterns would provide typical goals (reasons) for 
buying and using cameras. 

4 Toward a Practical Computational 
Approach 

We are now ready to describe the overall approach 
necessary for a more complete sentiment analy¬ 
sis system. For illustrative purposes we focus on 
simple binary (positive/negative) valence identifi¬ 
cation. However, the framework applies to finer 
granularity (e.g., multi-class classification, regres¬ 
sion) with minor adjustments. We first provide an 
overall algorithm sketch, provide a series of exam¬ 
ples, and then suggest models for determining the 
still unexplored aspects required for deeper senti¬ 
ment analysis. 

First, we assume that standard techniques are 
employed to find fhe following from some given 
fexf: 

1. Opinion Holder: Individual or organizafion 
holding fhe opinion. 

2. Enfify/Aspect/Theme/Facel: fopic or aspecf 
abouf which fhe opinion is held. 

3. Senfimenf Indicafor: Senfimenf-relafed fexf 
(tokens, phrases, senfences, efc.) fhaf indicafe 
fhe polarify of fhe holder. 

4. Valence: like, neutral, or dislike. 

These have been defined (or af leasf used wifh im- 
plicif definition) fhroughouf fhe senfimenf lifera- 
fure, and are defined for example in (Hovy, 2015). 
Of fhese, item 1 is usually achieved by simple 
mafching. Item 2 can be parfially addressed by 


recenf lopic/facel mining models, and ifem 3 can 
be addressed by exisfing senfimenf related algo- 
rifhms af fhe word-, senfence-, or fexf-level. Hem 
4 af ifs simples! is a matter of keyword mafching, 
buf fhe composifion wifin a senfence of confrasfing 
valences has generafed some inferesfing researech. 
Annofafed corpora (or ofher semi-supervised dafa 
harvesting techniques) mighf be needed for goal 
and need idenfificafion, as discussed above. 

Given Ibis, fhe following skefch algorifhm im- 
plemenfs deeper senfimenf analysis: 


1. In fhe fexf, identify fhe key goal underlying 
fhe Theme. 

2. Is fhere is no apparenf goal? 

• If yes, fhe opinion is probably non- 
ufilifarian, so find and refurn a valence 
if any, buf refurn no reason for if. 

• If no, go to step 3. 

3. Determine whefher fhe goal is satisfied: 

• If yes, go fo step 4, 

• If no, refurn a negative valence. 

4. Identify fhe subgoals involved in achieving 
fhe major goal. 

5. Identify how well fhe subgoals are safisfied. 

6. Determine fhe final ufilifarian sentiment 
based on the trade-off between different sub¬ 
goals, and return it together with the trade-off 
analysis as the reasoning. 


This procedure requires the determination of the 
Goals or Subgoals and the Condition/Situation 
under which the opinion holder holds that opin¬ 
ion. The former is discussed above; the latter can 
usually bet determined from the context of the 
given text. 

4.1 Examples and Illustration 

As a running example we use simple restaurant re¬ 
views, sentences in italics indicating original text 
from the reviews^: 

Case 1 

1. My friends and I went to restaurant X. 

2. So many people were waiting there and we 
left without eating. 

^These reviews were originally from yelp reviews and re¬ 
vised by the authors for illustration purposes. 



Following the algorithm sketch, the question “was 
the major goal of going to a restaurant ful¬ 
filled?” is answered no. The reviewer is predicted 
to hold a negative sentiment. Similar reasoning 
applies to Case 2 in Section 1. 

Case 2 

1. My friends and I went to restaurant X. 

2. The waiter was friendly and knowledgeable. 

3. We ordered curry chicken, potato chips and 
italian sausage. The Italian sausage was de¬ 
licious. 

4. Overall the food was appetizing, 

5. but I just didn’t enjoy the experience. 

To the question “was the major goal of being full 
fulfilled?” the answer is yes, as the food was or¬ 
dered and eaten. Next the algorithms addresses the 
how (manner of achievement) question described 
in steps 4-6, which involves the functional ele¬ 
ments of goals/needs embedded in each sentence: 

1. My friends and I went to restaurant X. 
Opinion Holder: I 

Entity/Aspect/Theme: restaurant X 

Need: sate hunger 

Goal: visit restaurant 

Sentiment Indicator: none 

Valence: neutral Condition: in restaurant X 

2. The waiter was friendly and knowledgeable. 
Opinion Holder: I 

Entity/Aspect/Theme: waiter 
Need: gather respect/friendship 
Subgoal: order food 

Sentiment Indicator: friendly, knowledgeable 
Valence: positive 
Condition: in restaurant X 

3. We ordered curry chicken, potato chips and 
italian sausage. Italian sausage was deli¬ 
cious. 

Opinion Holder: I 

Entity/Aspect/Theme: Italian sausage 

Need: sate hunger 

Subgoal: eat food 

Sentiment Indicator: delicious 

Valence: positive 

Condition: in restaurant X 


4. Overall the food was appetizing. 

Opinion Holder: I 

Entity/Aspect/Theme: food 
Need: sate hunger 

Subgoal: eat enough to remove hunger 
Sentiment Indicator: appetizing 
Valence: positive 
Condition: in restaurant X 

5. but I just didn ’t enjoy the experience. 

Opinion Holder: I 

Entity/Aspect/Theme: restaurant visit experi¬ 
ence 

Need: none — this is not utilitarian 
Goal: none 

Sentiment Indicator: didn’t enjoy 
Sentiment Eabel: negative 
Condition: in restaurant X 

The analysis of the needs/goals and their respec¬ 
tive positive and negative valences allows one to 
justify the various sentiment statements, and (in 
the case of tie final negative decision) also indicate 
that it is not based on utilitarian considerations. 

4.2 A Computational Model of Each Part 

Current computational models can be used to ad¬ 
dress each of the aspects involved in the sketch al¬ 
gorithm. We provide only a high-level description 
of each. 

Deciding Functional Elements. Case 2 above 
involves three of the needs described in Maslow’s 
hierarchy: food, respect/friendship, and emotion. 
The first two are stated to have been achieved. The 
third is a pure emotion, expressed without a rea¬ 
son, why the holder “just didn’t enjoy the experi¬ 
ence”. Pure emotions usually have no overt util¬ 
itarian value but only relate to the holder’s high- 
level goal of being happy. In this example, we 
have to conclude that since all overt goals were 
met, either some unstated utilitarian Maslow-type 
need was not met, or the holder’s opinion stems 
from a deeper psychologicaVemotional bias, of the 
kind mentioned in Section 1, that goes beyond util¬ 
itarian value. 

Whether the Major Goal is Achieved. To 

make a decision about goal achievement, one 
must: (1) identify the goal/subgoal of an action 
(e.g., buying the detergent, going to a restaurant); 
(2) identify whether that goal/subgoal is achieved. 
The two steps can be computed either separately 



or jointly using current machine learning models 
and techniques, including: 

• Joint Model: Annotate corpora for satisfac¬ 
tion or not for all goals and subgoals to¬ 
gether, and train a single machine learning al¬ 
gorithm. 

• Separate Model: 

1. Determine the goal and its plans and 
subgoals either through annotation or as 
described in Section 3.2. 

2. Associate the actions or entities of 
the Theme (e.g., going to a restau¬ 
rant; buying a car) with their respective 
(sub)goals. 

3. Align each subgoal with indicator sen- 
tence(s) in the document (e.g., “I got a 
small portion”; “the car was all it was 
supposed to be”). 

4. Decide whether the subgoal is satisfied 
based on indicator sentence(s). 

Learning Weights for Different Goals/Needs. 

One can clearly infer that the customer in case 2 
assigns more weight to the emotional aspect, that 
being his or her final conclusion, and less fo the 
food or respect/friendship (which comes last in 
this scenario). More formally, for a given text D, 
we discover L needs/(sub)goals, with indices 1, 
2,..., L. Each type of need/(sub)goal i G [1,L] 
is associated with a weight that contributes to the 
final sentiment valence decision Vi. In document 
D, each type of need i is associated with achieve¬ 
ment value tti that indicates how the need or goal 
is satisfied. The sentiment score Sd for given doc¬ 
ument D is then given by: 

Sf) — ^ ^ Vi • (Xi 

This simple approach is comparable to a regres¬ 
sion model that assigns weights to relevant as¬ 
pects, where gold standard examples can be the 
overall ratings of the labeled restaurant reviews. 
One can view such a weight decision procedure 
as a supervised regression model by assigning a 
weight value to each discovered need. Such a 
procedure is similar to latent aspect rating intro¬ 
duced in (Wang et ah, 2011; Zhao et ah, 2010) by 
learning aspect weight (i.e., value, room, location, 
or service) for hotel review ratings. A simple il¬ 
lustrative example might be collaborative filtering 


in recommendation systems, e.g.,(Breese et ah, 
1998; Sarwar et ah, 2001), optimizing need weight 
regarding each respective individual (which could 
be sampled from a uniform prior for humans’ gen¬ 
erally accepted weights). 

Since individual expectations can differ, it 
would be advantageous to maintain opinion holder 
profiles (for example, both yelp and Amazon keep 
individual profiles for each customer) that record 
one’s long-term activity. This would support indi¬ 
vidual analysis of background, personality, or so¬ 
cial identity, and enable learning of specific goal 
weights for different individuals. 

When these issues have been addressed, one can 
start asking deeper questions like: 

• Q: Why does John like his current job though 
his salary is low? 

A: He weighs employment more highly than 
family. 

• Q: How wealthy is a particular opinion 
holder? 

A: He might be rich as he places little 
concern (weight) on money. 

or make user-oriented recommendations like: 

• Q: Should the system recommend an 
expensive—but-luxurious hotel or a cheap- 
but-poor hotel? 

4.3 Prior / Default Knowledge about Opinion 
Holders 

Sentiment/opinion analysis can be considerably 
assisted by the existence of a knowledge base that 
provides information about the typical preferences 
of the holder. 

Individuals’ goals vary across backgrounds, 
ages, nationalities, genders, etc. An engineer 
would have different life goals from a business¬ 
man, or a doctor, a citizen living in South America 
would have different weighing systems from those 
in Europe or the United States, people in wartime 
would have different life expectations from when 
in peacetime. Two general methods exist today 
for practically collecting such standardized knowl¬ 
edge to construct a relevant knowledge base: 

(1) Rule-based Approaches. Hierarchies of per¬ 
sonality profiles have been proposed, and 
changes to them have long been explored in 



the social and developmental psychology lit¬ 
erature, usually based on polls or surveys. 
For example, (1981) found that children have 
higher physical needs than other age groups, 
love needs emerging in the transitional period 
from childhood to adulthood; esteem needs 
are the highest among adolescents; the high¬ 
est self-actualization levels are found with 
adults; and the highest levels of security are 
found at older ages. As another example, 
researchers (Tang and Ibrahim, 1998; Tang 
et ah, 2002; Tang and West, 1997) have 
found that survival (i.e., physiological and 
safety) needs dominate during wartime while 
psychological needs (i.e., love, self-esteem, 
and self-actualization) surface during peace¬ 
time, which is in line with our expectations. 
For computational implementation, however, 
these sorts of studies provide very limited ev¬ 
idence, since only a few aspects are typically 
explored. 

(2) Computational Inference Approaches. 

Despite the lack of information about in¬ 
dividuals, reasonable preferences can be 
inferred from other resources such as online 
social media. A vast section of the Social 
Network Analysis research focuses on this 
problem, as well as much of the research of 
the large web search engine companies. Net¬ 
working websites like Facebook, Linkedin, 
and Google Plus provide rich repositories 
of personal information about individual 
attributes such as education, employment, 
nationality, religion, likes and dislikes, etc. 
Additionally, online posts usually offer direct 
evidence for such attributes. Some examples 
include age (Rao et ah, 2010; Rao and 
Yarowsky, 2010), gender (Ciot et ah, 2013), 
living location (Sadilek et ah, 2012), and 
education (Mislove et ah, 2010). 

5 Conclusion and Discussion 

The past 15 years has witnessed significant perfor¬ 
mance improvements in training machine learn¬ 
ing algorithms for the sentiment/opinion identifi¬ 
cation application. But little progress has been 
made toward a deeper understanding about what 
opinions or sentiments are, why people hold them, 
and why and how their facets are chosen and 
expressed. No-one can deny the unprecedented 
contributions of statistical learning algorithms in 


modern-day (post-1990s) NLP, for this applica¬ 
tion as for others. However, ignoring cognitive 
and psychological perspectives in favor of engi¬ 
neering alone inevitably hampers progress once 
the algorithms asymptote to their optimal perfor¬ 
mance, since understanding how to do something 
doesn’t necessarily lead to better insight about 
what needs to be done, or how it is best repre¬ 
sented. For example, when inter-annotator agree¬ 
ment on sentiment labels peaks at 0.79 even for 
the rather crude 3-way sentiment granularity of 
positive/neutral/negative (Ogneva, 2010), is that 
the theoretical best that could be achieved? How 
could one ever know, without understanding what 
other aspects of sentiment/opinion are pertinent 
and investigating whether they could constrain the 
annotation task and help boost annotation agree¬ 
ment? 

In this paper, we described possible directions 
for deeper understanding, helping bridge the gap 
between psychology / cognitive science and com¬ 
putational approaches. We focus on the opin¬ 
ion holder’s underlying needs and their resultant 
goals, which, in a utilitarian model of sentiment, 
provides the basis for explaining the reason a sen¬ 
timent valence is held. (The complementary non¬ 
utilitarian, purely intuitive preference-based basis 
for some sentiment decisions is a topic requir¬ 
ing altogether different treatment.) While these 
thoughts are still immature, scattered, unstruc¬ 
tured, and even imaginary, we believe that these 
perspectives might suggest fruitful avenues for 
various kinds of future work. 
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